COMPUTATION OF EXPANSIONS FOR THE MAXIMUM LIKELIHOOD 
ESTIMATOR AND ITS DISTRIBUTION FUNCTION 



SHANTI VENETIAAN* 

Abstract. In this paper, insight is given in the techniques used to compute asymptotic expansions. In 
a broad fashion the technique is described. Most of the results apply to the paper " An expansion for the 
maximum likelihood estimator and its distribution function" , which will be submitted. 
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1. Expansions. In the paper " An expansion for the maximum likelihood estimator and 
its distribution function" , which will be submitted, many expansions are being calculated. 
Because the technique itself is not so difficult and the outcomes take a lot of space to present, 
many steps of the computation of the expansions will be omitted in that paper. However if one 
wants to check the computations, it may be useful to have some insight in how the expansions 
were obtained. None of the applied techniques are claimed by the author. They are just written 
down. We will give the full outcome of all the steps needed to construct the needed expansions. 
We will not give any proofs, just the method of obtaining the expansions. This means that 
certain rest terms will be omitted. Also note that the results are only valid for the maximum 
lielihood estimator of location. 

2. An expansion for the maximum likelihood estimator. We define the maximum 
likelihood estimator 9 n by 

(2.1) L n (6 n ) = inf L n (6), 

where L n {6) = n^ 1 Y^i=i P(%i ~ 0)> where /?(•) = — log(-). It may be proved that (cf. Chibisov 
(1973)) 6 n is the solution of the equation 

(2.2) L' n (9) = 0, 

with probability 1 + o(?i~ 3 / 2 ). We expand L' n (0) with a Taylor expansion and get 

n n „ n nl n 

(2.3) l'm = i5:^-tf) = iE^*)-^E^w + | ; E^ ) w 

i— 1 i— 1 i— 1 i—l 

i—l i—l 

where \6'\ < \8\. 
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We introduce the notation 

n 

(2.4) J2(P U) ( X i)- a j)> aj = EopW(X) for j = l,...,5. 



i=i 



Note that the are normalized sums and that ai = 0. (|2.3p becomes 
L' n (6) = ^L-6(^+a 2 ) + ^(^L+a 3 ) 

(2.5) _^ +0l) + g ( ^ + 05) + .., 

To find the expansion for # n we put 

(2.6) § n = Bi/Vn + B 2 /n + 5 3 /n 3/2 + B 4 /n 2 . 
Substituting this into (|2.5p leads to 

(-02B1 + Ci)/^ 172 + (-6^1 - a 2 5 2 + ^a 3 B 2 )/n 

(2.7) + (-6S 2 - \a±B\ + U 3 Bf + a 3 B x B 2 - a 2 B 3 )/n 3 ' 2 

2 

+ {~a 4 B 2 B 2 + \a 3 B 2 + ^-a 5 Bf - &B 3 + &B X B 2 - + a 3 B x B 3 - a 2 B 4 )/n 2 

2 2 24 O 

Now we take the first term of (|2.7|) and put it equal to 0. We get 

(2.8) -a 2 Bi+& =0^ fli =&/oa. 
Substituting the obtained _Bi in (|2.7|) gives 

(2.9) (-66/^2 + ^a 3 6 2 /«2 - a 2 S 2 )/n 

+ (-a 2 S 3 + a 3 ^B 2 /a 2 - i 2 B 2 + ^ 3 g/4 - ^a 4 g/4)/n 3 / 2 
+ (a 3 £iB 3 /a 2 + -^a 5 £,f/a 2 - ^a 4 £, 2 B 2 /al - 

g&Ci/aa + ^3S 2 2 + teiB 2 /a 2 - &B 3 - a 2 B A )/n 2 

Note that the \j\fn term has vanished. We take the first term of (|2.9p and put it equal to 0. 
This results in 

(2.10) B 2 = -66/a 2 . + ^ 2 a 3 /4 
We substitute this B 2 in (|2.9[) and get 

^a^l/a 3 + ^ 3 &/4 - ^ 2 &a 3 /4 + & X /4 + , 



(2.11) (-a 2 5 3 - -a 4 6 3 /«2 + ^s&/4 ~ ^2&a 3 /4 + &i/a 2 2 + ^f4/4)/n 3/2 



(-~&£i/ai + adiB 3 /a 2 + -^4/4 + -^fa 3 /4 

\g&4l4 - 6^3 - 66 2 6/«i 

+ ^a5^i/a 2 + ^a3^ 2 ^ 2 /a 2 + ^4??6/«2 - a i B ± - ^^a 3 /4)/i 
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Again we put the first term of the result to and get 

(2.12) B 3 = tel/al - + \&&/4 - |£W*2 + \t\4l4- 

We substitute B 3 in (|2.1ip to obtain 



( 2.1 :•> ) -a 2 B 4 - ^^4/4 + ^4/4 ~ £ti/<4 + &ga, 3 /4 ~ 



+ 1^1^/4 + ^a 5 g/4 - ^Ug/4 + 3a 3 CiC 2 2 /«2 " ^Cta 3 /4- 
This is put equal to and at last we obtain 



(2.i4) b 4 = - \e x ^al/4 + \t£4/4 - ^1/4 - 

1 2 ' ■■ y^/4 +3^1/4 -4 



- t;^2/4 + + 777^/4 + Zga3&/4 - 777^0403/0!. 



Eventually 



v^(e„) = 6 1 1 ( ~^ 2 1 fl3 ^) 1 , ^3 , 4ti 

0,2 y/n 4 ^4 n 4 2a| 24 2a| 6a| 

(9 ,~ . 1 / 3^03^1 , 5^oj 5^a 4 03 3ff&6 5^o§6 fffl 5 

1 ' n 3 / 2 V «2 8a^ 12a! ^4 ^4 ^4 

a! 3a| 6a| af 

3. Expansion for the distribution function of the maximum likelihood estima- 
tor. The estimator in (I2.15[) fits the model of Hall (1992), Section 2.3. This means that the 
cumulants of y/n9 n will determine the expansion for the distribution function. First we note 
that the cumulants will be of the form (cf. Hall(1992), Section 2.3) 

ki = + ku/y/n + k 13 /n 3/2 H 

k 2 = k 2 i + k 22 /n-\ 

(3.1) K 3 = k 31 /v^+k 32 /n 3/2 + ••• 

«4 = kii/n + ■ ■ • 
«5 = hi/n 3/2 H . 

Furthermore (cf. Hall(1992), Section 2.2) 



(3.2) 





= ES n 






K 2 


= ESl - 


- (ES n ) 2 




«3 


= E(S n 


- ES n ) 3 


= ES 3 n ~ ZES 2 n ES n + 2(ES n ) 3 


K4 


= E(S n 


- ES n f 


— 3k 2 


«5 


= E(S n 


- ES n f 


- 10k 2 k 3 . 
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3.1. Computation of the kappa's. We will now compute the kappa's. For the compu- 
tation of the kappa's we need to calculate the expectation of the normalized sums, the so called 
£j's. Terms that become too small will be omitted. First we will introduce the notation 

(3-3) M-) = y (■) 



(3.4) m = E(^(X i )), m = E(ipf(X i )), ru = E{tf{Xi)), 
V5 = E^KXi)), m = E^siXi)) 

the above results in 

(3.5) cti =0, a 2 = E(il) 1 {Xi)), without loss of generality we put a 2 = 1, 

12 3 
a 3 = ~2 ?73 ' a 4=3 ? 74-?72, as = 5ry 6 - 

and that 

12 3 

E(i>iip 2 ) = E^ips) = ~m + g»74, E^x^i) = -5r] e + -775 

E(^ 2 ) = ^m, £(Vi^) = 2%, S(^ 2 ) = ^ 5 , E(tffo) = -4% + ^r? 5 
Furthermore 

iOj = -(p^iXi) - a.,), for j = 1, ...,5. 

Consequently, 

(3.6) wi = -0i, 

W>2 = 02 ~ V>1 + ! 5 

w>3 = 03 - 30i0 2 + 2-0i + a 3 , 

W4=tp4 — 4^103 + 12^1^2 - 3^2 - 60f + 04 

io 5 = 05 - 50i0 4 + 2O0?0 3 - 1O0 2 3 + 30-0101 - 6005*02 + 240J 5 + a 5 

Note that £?Wj = for j = 1, • • • 5 and that E{w\) = 1. 

12 3 
£(101102) = --%, £(wiw 3 ) = -774 - f?2, E(w 1 w i ) = 5r/ 6 - -775 

1 5 1 

£(u^to2) = --774 + 1, E(wlw 3 ) = -Aria + -r) 5 - -773 

E{w\w 2 ) = ~r] 5 + T) 3 , E{ Wl wl) = 2i] 6 - i % - t] 3 



CALCULATION OF EXPANSIONS FOR THE MLE AND ITS DISTRIBUTION FUNCTION 5 



1 



1 1 



E(l0 2 ) =T] 2 - - 1, E(w 2 W 3 ) = -T) 6 + -T) 5 + -773 

We will give an example here to illustrate how the expectations of the terms of \fnd n are 
obtained. 



(3.7) 



i<3 



, 2n(n — 1) 
-{nEw\ + — — r ■ ' ■ ' • 1 r " 1 " 



1 

n 



-EwxEw-t) = Ew{ + = £u; 2 = 1. 



(3.8) Eg 



„6 „.,2 



z 

+ @EE^ + 0EE^< 
4 2 2 EE E + ( 2 3 3 ) EE E 



+ 



+ 



'W 



Ik 



2,2,2,2 



EEE E 



i<j<k<l 



WliWljWlk w ll] 



2,2,2,2 



n(n- l)(n - 2)(n - 3) 2 4 
ij ( Ew i > 



+ 



+ 



8 \<--l)(n-2J Ewt{Ewl)2 



2,2,4 
8 

2,3,3 
1 r 



2! 

n(n- l)(n-2) 
2! 



2\2 



105(n 4 - Qn A + lln 2 - 6n)(Ew() 4 + 2lQ(n 6 - 3n 2 + 2n)Ewl(Ew{) 



+ 280(n a - 3n 2 + 2n)(Ewf) 2 Ewl + ... 



1 



= l05(Ew( ) 4 + -[-630(£<) 4 + 2lQEw\{Ew{ ) 2 + 280(£u;5 5 ) 2 £;u;f] + ... 
n 

= 105 + - [-630 + 210?74 + 280/7?] + ■ ■ ■ ■ 
n 

The following equations give formula's for the other expectation that have to be computed. 



SHANTI VENETIAAN 



2k 

■■■,2j k\ 



2\k 



(Ewt) 



+ 
+ 



2k 



1 



4,2,---,2y (fc-2)! 
2k Ml 



3,3,2,- • -,2J 2 {k - 3)! 



Ew\{Ew\) k - 2 

(EwlfiEwlf-* 



+ ■ 



E^ k+1 ) = - 



2fc + 1 



3,2,--.,2; (fc-1)! 



{Etui)*- 1 Evil 



2k + 1 



ny/nl \2J \3,2,---,2J (k - 1)! 



+ 



+ 



2fc + 1 



5,2,---,2y (k- 2)! 



1 



2k + 1 



1 



v 4,3,2,--.,2; (fc-3)! 
2, ...4 we have 



( J Bw;?) fe - 3 ^ J E;w;? 



+ 



2k 



2k 



l,3,2,---,2/ (fc-2)! 



-EwfEwiWj{Ew{ 



2\k-2 



n^/nl (fc- 1)! \2, • • ■ ,2 



2k 



Ewfw j (Ewl) k - 1 



2k 



(k-2)\ Vl,3,2,--.,2 
2fc \ 1 



+ 



+ 



5, 1,2, •••,2; (fc-3)! 
2k \ 1 



EwlEw 1 w j (Ewl) k - 2 
Ew 5 1 Ew 1 w :j (Ewl) k - 3 



4,2,--.,2; (fc-3)! 
2fc \ 1 



Ew\Ewiw 3 {Ew{f 



3,3,2, •••,2/ (fc-3)! 



^EwlEw\wj(Ewl) k -* 



2fc 



4,2,--.,2; (fc-2)! 



1 



-.Ewlw^Ewi) 



2\k-2 



+ ■ ■ 



E(& k+ %) = (2k + l)(2k-l)---l(E(wl)) k E Wl w 2 



+ 



I 2fc + l 



+ 



k\ V 1,2 



2fc + 1 



Ew\W2{Ew 1 ) 



(k-2)\\4, 2 



Ew\EwiW2(Ew{ 



2\k-2 
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1 1 

+ 77- 



2fc + 1 



2(fc-3)!V3,3,l,2,---,2 



{EwiyEwiw 2 {Ew{) 



2\k-3 



1 



2fc + 1 



(fc-1)! V3,2,---,2 



Ewfw 2 (Ew() 



2\k-l 



+ - 



1 



2k + 1 



(fc-2)!V3,2,---,2 



Ew{Ew{w 2 {Ew{) 



2\k-2 



+ ■ 



(3.13) 25(£*£) 



+ 



+ 
+ 



+ 



2k \ 1 



2,---,2/fc! 
2fc 

l,l,2,-..,2; (fc-1)! 



1 



+ - 



2fc 



1 



4,2,-. -.2; (fc-2)! 
2fc \ 1 



3,3,2,---,2y 2- (fc-3)! 
2fc \ 1 



Ewi{Ew{) k - 2 Ewl 
{Ew\f{Ewl) k - s Ewl 



Ew\{Ewiw 2 Y{Ew{) 



2\k-3 



4,1, 1,2, •••,2y (fc-3)! 

^^ lU ;|(i?«;2)fe-2 



w 2 Ewxtv-2 (Ewj ) k ~ 2 



l,3,2,--.,2; (fc-2)! 
2^ \ (?) 



1,3, 2,--., 2; (fc-2)! 
2^ \ (?) 



1,3, 2,--., 2; (fc-2)! 
2fc \(Y) 



2,---,2J fc! 

2^ \ (?) 
2,---,2yl2(fc-2)! 

2fc \ ft 1 ) 



l,l,2,--.,2y (fc-1)! 
2fc \ 1 



(Ewj) k Ew 2 

{Ew\w 2 f{E W l) k - 2 
{Ew 2 1 ) k - 1 {Ew 1 w 2 ) 2 



(EwlwliEwlf- 1 



2,---,2j (fc-1)! 



+ 



(3.14) 



9k \ 1 
2i ...^)k\ {E{wl)kEW2W ^ 



1 



2fc 



(fc-1)! Vl,l,2---2; 



I Ewiw 2 EwiW3 + ■ ■ 



(3.15) £(£ fc+1 &&) 



2k + 1 



3,2,- • -,2/ (fc - 1)! 



1 



-EwfEw 2 w 3 (Ew() 



2\k-l 
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1, 1,3,2,- - -,2y (fc-2)! 



Ew'{Ew 1 W2EwiWz{Ewl) 



2\k-2 



1 



2fc + 1 
1.2.---.2./ (k- I.)! 
2fc + l \ 1 



l,2,-..,2; (fc-1)! 
2fc + 1 \ 1 



Ewlw 2 Ew 1 w 3 (Ewj) k 1 
EwiW2Ewlw 3 (Ewl) k ~ 1 



1,2,- • -,2/ fc! 



EwiW2Wz(Ew\) k 



+ ■■-. 



(3.16) £fe 2fe+1 £ 2 2 ) = 



2fc + 1 



^^3,2, ••-,2/ (fc- 1) 



3 c...2/c„..2\fc-l 



-Ew{Ew z 2 {Ew{ 



+ 



2fc + 1 



1 



+ 



l,l,3,2,--.,2y (fc-2)! 

2fc+ 1 \1 
l,2,--.,2jfc! 
2fc+l \ Q 



EwfiEw^riEwf) 



2\k-2 



l,2,-..,2; (fc-l)! 



+ ••■ 



(3.17) £(£ 2fc+1 £ 2 3 ) - 



(i 2 v +1 , 2 )l^-^^) s 



2fc + 1 



1,1, 1,2, •••,2y VlH/3!(fc- 1) 



1 



-{E Wl w 2 f{Ewl) k - 1 + 



(3.18) £(£ 2fe £ 2 3 ) = ~ 



2fc 



(?) 



VnLVl,3,2,---,2y (fc-2)! 



E W ^EwiEwiw 2 (Ew() 



2\k-2 



2k 



+ 



+ 



2, •••,2; (fc-1)! 
1 / 2fc 



(fc-3)! Vl, 1, 1,3,2, - - - ,2 
2fc \ 3 



l,l,2,--.,2y (fc-1)! 
2fc \ 3 



EwlwiEwliEwlf' 1 

Ewl(E Wl W2f(Ewl) k - 3 
(Ew\) k ' 1 EwiwlEwiw 2 



l,l,2,-..,2; (fc-2)! 



(Ew() k - 2 : Ew(w 2 (Ew 1 w 2 y 



+ 



(3.19) E(£t*$) = 



2k 

2,---,2j fc! 



-(^ 2 2 ) 2 (^ 2 ) fc 
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»,,*..,,)irV^' e ** w 

Further computations lead to 

.„ . ^ n i] 3 1 1 1 1 5 11 o 3 

(3-20) ES n = — + — { - m r, 3 + -r, 5 -- 4m + - mm -- V3 -- V6 ) + ... 

ESl = i + i(-i % 2 - + + 

5 «3 1 , 5 35 45 3 15 45 21 , 

^ = 47^ + ^ (_ ^ 3 + ¥^ 2_ 3^ % -T % ~V' 6+ 16 ?75) + --- 

^S* = 3 + i(107 ?2 -9 + i7 ?3 2 -yr /4 ) + --. 

_ 5 35% 1 . 175 525 875 3 259 525 105 , 



Finally, by using (|3.2[) we get the cumulants, 



,„ ^ m i,i i i 5 n , 3 . 

(3.21) «x = ^ + ^(gWs + ^ 5 - ^3 + - W2 - - % - -, 6 ) + ■ ■ ■ 

1,1, 1 

K2 = 1 + - 1 - 0% + ?72 H 

n 8 3 
% 1, 9 1 9 13 3 9 . 

K3= 2^i + + 3713112 2™ + 8 V5 16 % " 2 m) + ' ' ' 

1 5 
k 4 = -(-3 - -ry 4 + 4772) H 

77 3 

1 15 

K 5 = ^u?(- 15r) 6 - 10??3 - 5773774 + I5773772 + 4775 - -—773) H . 

n A ' z 8 

Note that indeed they are of the form in (|3. II) . 

3.2. Finding the polynomials of the expansion. We will now find the polynomials 
which make up the expansion of the distribution function. 
We view the characteristic function as 

(3.22) exp{ Kl (zi) + \n 2 (itf + ^ 3 (itf + -U 4 (^) 4 + T^s^) 5 + •••} 

z 24 12U 

By using (|3 . 1 1) we get 



exp{(7i)(^ + — -=) + -{it) (1 + — ) + -{ity{—= + —=) 

Jn nwn 2 no Jn nJn 
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24 v ; n 



1 /..n 5 fe 51 i 

120 1 J W^ 1 



= cxp{-it 2 }exp{-i=(fc 12 ^) + ^k 31 (it) 3 ) + I(lfc 22 ^) 2 
Constructing a Taylor expansion for the above gives 



(3.23) 



exp{-^ 2 }exp{-^(fc 12 ^) + |fc 3 i(^) 3 ) + ^{\k 22 {itf 

+ ^fc4i^) 4 ) + ^(Mit) + ^ 32 («t) 3 + ^hi(it) 5 )} 
= exp{-it 2 }[l + -i=(M**) + ^M**) 3 ) + -(^fc 22 ^) 2 
+ 2^4i(^) 4 ) + ^(M**) + lh 2 (itf + ^fe(it) 5 ) 

+ J(i(fci 2 ^) + Jfc 3 i(^) 3 )) 2 ) 
2 n o 

+ + ^ 31 ( l t) 3 ))(ifc 22 (*t) 2 + ^M**) 4 + ..) 

2 n n^Jn 



Consequently, 



(3.24) n(it) = {(it)k 12 + -(itfk 31 ) 

(3.25) r 2 (zt) = { l -{it) 2 k\ 2 + l(zt)6 fc3 2 1 + I^)4 fcl2 fc 31 + ^^) 4 fc 41 + i(zt) 2 fc 22 ) 

(3.26) r 3 (it) = {^{it) 7 k 12 k 2 31 + ^{itfk 12 k iX + ^{itfk 22 k 31 + ^(it) 7 k 31 k 4 i 

+ i4o fc51 ^ 5 + ^^ 5fc 12 fc31 + ^(^) 3fc 12 fc 22 

+ i^) 3 fc 32 + (»t)fcl3 + ^(^) 3 ^ 3 2 + ^(^) 9fc 3 3 l) 

The polynomials of the expansions are now( cf. Hall(1992), Section 2.2) 



(3.27) Pl 

(3.28) P2 

(3.29) P3 



2) 



19 



10368 
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, 19 3 1 1 1 , 4 , 5 35 3 1 1 \ 2 

+ W 3 - 30^ + 8 Ve ~ 72 mV3)x + ( "96 W3 + 864 % + 32* + 80*°* 
35 , 5 1 1 

+ 432 % " 48^ 3 + 40 775 + 16 773 
The expansion for the distribution function of the maximum likelihood estimator is now 



(3.30) G n {x) = + -= Pl (x)<j>(x) + -p2(x)<Kx) + ^psix^ix) + o{ n -^ 2 ), 

y/n n n J ' z 

with G n (x) = P (y/n9 n < x). 

3.3. Finding the Cornish-Fisher expansion for G~ 1 (u). We will now find a Cornish- 
Fisher expansion for G~ 1 (-). 

Assume that G.7 1 is of the form 



(3.31) G- 1 (u)=z u + 4= + ~ ( 



Jn n n 3 / 2 ' 

where z u denotes $~ 1 (it). We construct Taylor expansions for the terms at the right hand 
side of (|3.30p and plug G" 1 ^) into these expansions. 
The first term of (pHOj) 



(3.32) ^(G- 1 ^)) = $( z „ + A + ^ + _^L) 

y/n n nrl A 



$(z u ) + (A + — + -^)4>(z u ) + ~(A + — f ■ -z u c/>{z u ) 
y/n n n a l 2 y/n n 

+ \{^f{zl -l)c/>(z a ) 
o y/n 

u+[^ + U-\z u A*+B) 
y/n n 2 

n 6 ' z 6 6 



The second term of (|3.30[) 



, nnn y 1 A B.,, A B. 

(3.33) — Pl (z u + — + -)<p(z u + — + -) 
y/n y/n n y/n n 

= J-(-± m (( Zu + A + -? + 2))[i - ^(4= + -) + \(£ i)(4) 2 ]^«) 

y/n 12 y/n n y/n n 2 y/n 



1 



1 

12 



V3Z V 



6 12n 



,3/2 



4>{z u ) 



The third term of l|3T30|) 
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(3.34) 



P2(z u 
( 



A 



A 



1 

288 



(^ + ^a 2 -^)(, u + ^)[l 



72 
A 



A 



Zu{—^-)](t>{z u ) 
\ n 



[1, 1 ,5 ,1 1 2 5 1 , 3 ,1 1 2 1 . 

-(-288%*« + ( 8 + 72 % + T2 774 " g^* + ( 8 + 24 % " 24^ 



1 



1 



1 



1 



1, 



,11 1 - o 1 



r»?4 



4 4 ' 2 
The last term of ([3301) 



1 

24 



1 

24 



ry 4 )A 0(z„) 



1 ^ s / 1 19 , 1 5 , , 

= ( ~ lOSeS 7732 " + { 96 m + 10368 773 " 72^ 3 ^ 2 + Sel^^ 

, 19 3 1 1 1 , , . 5 35 . 1 l,o 

+ W 3 " 30 775 + 8 ?/6 - 72 Vim)z - + ^m™ 3 + 864 % + 32^ + 80*>*" 
35 3 5 1 1 w . , 

+ 432 Tl3 ~48 V4m+ 40 Tl5+ m m) ^ Zu) 
We take all the terms of the order 1/y/n together to find A. 



(3.36) A=^(z 2 u + 2). 

Next, we take all the terms of order l/n, plug in the found A, to get B 



(3-37) B = 1 % 2 - y 2 m + \m)zl + (-^ - g + 

By plugging A and S in (|3~32"|) . ([535]) . (|3~M)l . (l3~55)) and taking all the n _3/2 terms together 
we find 



(3.38) 



C = 



= (- 










144 774773 - 




+ (- 


5 






Is 7 ^ 




80 V5 - 



1 1 19 

H ?7n ?7fi 

30 ' 8 ' 1728 

67 3 1 , 2 

1296% + 



4)4 



12 



m 



40 



113 
1296 
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